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FIELD OF THE INVENTION 

The invention relates to a method for creating an icon, rqjtesenting a group of 
images comprising aplurality of images, where the icon is composed of a selection of images 
from that group of images. The invention fiirfher relates to a computer system, computer 
program product and a data carrier. 

BACKGROUND 

Graphical user interfeces of, for instance, personal computera, digital cameras 
or other similar devices, may be used to store, retrieve, print and watch digital images, such 
as photos. Nowadays it is also possible to view your personal images on a remote location via 
a web browser, that are stored by. for instance, a photo service. The user may select unages 
to be printed by the photo service. 

A single device may comprise hundreds or even thousands of images. In order 
to organize such big amounts of data, the images are usuaUy divided in albums or groups. 
Such a group is represented by an icon and its associated metadata such as a tiHe, date etc. 
When dealing with large collections of images, a user prefers to browse and searlh through 
such a coUection using so-caQed group-based search tools. 

Rather than using a fixed predetermined icon, in known graphical interfeces it 
is often possible to select a representative image firom the group to be used as an icon for that 
group. This aUows the user to find the group that he/she was looking for more easily. 
However, it is oflen very difiScult to select a single image as representative for the entire 
group. Not only does this demand several actions by the user, but since a single group may 
comprise hundreds images, it may also be diflBcult for the user to select a smgle image as 
representative for the group. 

Some media browser mterfeces automatically select an image that may be 
rg,resen1ative for the group, as for instance the first or last image of a group. It is also known 
to select the image that is last viewed by a user as an icon, resulting in a constantly changing 
icon, which is confiising for a user. 
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Some media browsers interfeces use an icon that is composed of more tiian 
one image, for instance a grid of four images to represent a group of images. However, the 
selection of these images is also made from Ifae images lhat are first in the group or have been 
viewed last. 

SXJMMARY OF THE INVENTION 

Object of the invention is to provide a method and apparatus Aat 
automaticaUy generate an icon that is representative for a group of images. In order to obtain 
this object, the invention provides a method as defined in the outset, characterized in Ifaat the 

method conq)rises: 

determining a relative inaportance of each image and 

generating an icon composed of a selection of images based on the determined 

relative importance of each image. 

According to this method, an icon is generated automatically tiaat is 

representative for the group of images. 

It is noted Ihat US 2003/01 17651 Al describes a method of creating a photo 
album, where a photo album is a coUection of photos arranged in pages. The method 
detsm^s the inqwrtance of each photo to determine a layout of the album. Pictures with a 
relatively hi^ importance are, for instance, prints bigger and in the center of a page. The 
inqjortance of eachphoto is determinedby collecting affective information about each photo. 
Affective information may be: viewing time, fecial expression and/or head movements of the 
user while watching tiie photo, physiological reactions, such as heart rate, ten^erature, 

galvanic skin response of the user while watching the photo. 

US 2003/01 17651 Al does describe a method for determming the relative 

importance of pictures, but only uses this determined importance to prepare a layout for a 

photo album. The method does not involve any selection of an icon 4at is representative for 

a group of images. 

According to an embodiment of the invention, the relative inqjortance of each 
image is determined based on at least one of: 

the time span an image is displayed, 
the presence of manual amotations, 

number of times an image has been selected for a sUde show, 
number of copies that have been printed and/or sent, 
explicit user rating. 
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rareness in the collection measured using image similarity, 
presence of faces (or other objects) detected with automatic face (object) 

detection. 

These are parameters that give a good indication of the relative importance of 
5 an image as experienced by a user and that can easily be recorded. 

According to an embodiment of the invention, the number of images that is 
incorporated in the icon is selected based on the determined relative importance of each 
image. In the case where a few images seem to be &r more important than the other images, 
these images may be all incotporated in the icon. The number of images incorporated in the 
10 icon is thus not fixed, but is adapted to the determined importance. 

According to an embodiment of the invention, the layout of the icon is 
selected based on the determined relative importance of each image. The layout may be 
adjusted to embody a true account of the determined importance. 

According to an embodiment of the invention, the size of each selected image 
15 in the icon is proportional to the relative importance of each image. By adjusting the size to 
the determined importance, the icon gives a true account of the determined importance. 

According to an embodiment of the invention, the position of each selected 
image in the icon depends on tihe relative importance of each image. For instance, relatively 
less important images may be positioned ftirfher away from the centre of the icon. 
20 According to an embodiment of the invention, the group of images comprises 

a plurality of stills from a movie. The group of images may also be stills from a movie. The 
relatively most important stills may be incorporated in the icon representing that movie. 

According to an embodiment of the invention, the group of images comprises 
a plurality of icons, for instance representing a group of images, a movie, a computer 
25 program or application. An icon may be generated according to the invention that represents 
a number of icons. In cases where large quantities of images need to be organized that are 
mutually arranged in a more complex hierarchic order, such icons, representing a group of 
icons may be very useftil. 

According to an embodiment of the invention, the icon is a desktop. The 
30 layout of a desktop may be viewed as an icon representing the contents of a computer. 
Therefore the layout of a desktop may be determined according to this invention. The 
selection of images, their mutual position, their size etc. may be determined on the basis of 
the determined importance of each image. 

According to an embodiment of the invention, the method further comprises 
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determining a relative order based on the detennined relative importance of each image. In 
the case where the group of images is a group of pictures, the order in which the pictures are 
presented to a user, may be detennined by the determined relative importance, preferably 
presentmg the images in an order of decreasing importance. 
5 According to a further aspect, the invention relates to a computer system 

comprising processing means and memory means, the processing means being arranged to 
communicate with the memory means, titie computer system being arranged to create an 
icon, representing a group of images comprising a plurality of images, where the icon is 
composed of a selection of images from that group of images, characterised in the following 
10 - the processing means are arranged to determine a relative importance of each 

image and 

the processing means are arranged to generate an icon composed of a selection 
of images based on the determined relative importance of each image. 

According to a further aspect, the invention relates to a computer program 
1 5 product to be loaded by a processor in a computer system, Ihe computer system comprising 
processing means and memory means, the processing means being arranged to communicate 
with the memory means, the computer program product being arranged to carry out a method 
for creating an icon, representing a groiqp of images comprising a plurality of images, where 
the icon is composed of a selection of images from that group of images, characterised in that 
20 the method comprises : 

determining a relative importance of each image and 

generating an icon composed of a selection of images based on the determined 
relative importance of each image. 

According to a ftirther aspect, the invention relates to a data carrier comprising 
25 a computer program product in accordance with the above. 

According to a ftirther aspect, the invention relates to a method for 
determining a relative order of a group of images comprising a plurality of images, 
characterised in that the method comprises: 

determining a relative importance of each image and 
30 - determining the relative order based on the determined relative importance of 

each image. For instance, in the case where the group of images is a group of pictures, the 
order in which the pictures are presented to an user, may be determined by the determined 
relative importance, preferably presenting the images in an order of decreasing importance. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will be explained with reference to some drawings which are 
only intended to illustrate the present invention and not to limit its scope which is only 
limited by the appended claims. 

Fig. la and lb show a first and second layout, that may be used in the 

invention; 

Fig. 2a and 2b show a first and a second icon generated according to the 

invention; 

Fig. 3 shows a computer system arranged to be used in the invention; 
Fig. 4 shows a flow diagram of a computer program according to an 
embodiment of the invention. 

DESCRIPTION 

According to a preferred embodiment of the invention, the invention is a 
method comprising the following: 

a) computation of image importance, 

b) selection of layout, 

c) automatic creation of icon, and 

d) interactive editing of the icon. 

a) compu tation of imap;e fmpnrtannf* 

First an importance li of each image is determined, where If is preferably a 
number between 0 and 1. 



The importance li of each image may be determined based on one or more of 
the following fectors: 

a time span an image is displayed, 
a presence of manual annotations, 

number of times an image has been selected for a slide show, 
number of copies that have been printed and/or sent, 
an expKcit user rating, 

rareness in the collection determined using image similarity, 

presence of faces (or other objects) detected with automatic face (object) 

detection. 
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If, for instance, the time span an image has been displayed is taken as a fector 
for determining the relative importance of an image, the importance li of image i is 
determined by: 




where Ti is the time image i has been displayed and Tm = max{Ti ... Ti...TN}, where N is the 
number of images that have been displayed (i.e. is the maximiim time span of all images 
having been displayed). 

It will be understood that the importance of an image may be determined by 
using one of these fectors, but may also be determined based on a selection of these factors or 
based on all of these fectors. Also other factors from which the importance of an imagp may 
be determined could be taken into account without departing from the spirit of the invention. 

When more than one factor is taken into accounl^ the importance of an image 
may be determined by conqmling a wei^ted average of the different fectors. 

The importance of each image may evolve in time. Every time a factor that is 
taken into account for detemiining the relative inqwrtance of an image changes, the relative 
importance changes. For mstance, every time an image is displayed, the relative in^ortance 
based on the displaying time span changes. 

It is also possible to take into account the time that has passed since a certain 
factor has last been changed. For instance, in case a certain picture has been displayed very 
often, but all displaying time has been recorded more than a year ago, while another image 
has been displayed relatively very often during the last months, this could also be taken into 
account 

b) selection of layout 

Aftrar the relative importance of each image has been determined, a layout 
selection 11 , 12 can be made for an icon. This selection may be done automaticaUy, but may 
also be done manually by the user, if he/she desires. 

If, for instance, 6 images of a group have a relative importance that is 
significantly high compared to the other images in tiiat group, these six images are selected 
for being used to construct an icon. Next, an icon layout may be selected that allows to 
comprise 6 images. Examples of such icons 11, 12 are shown in Fig. la and lb. Of course. 
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the icon may further comprise other components, such as a text giving a description of the 
kind of images being represented by the icon (e.g. "holiday 2001"). 

If all six selected images have an approximately equal relative importance, the 
icon layout 1 1 depicted in Fig. la is preferably selected. If one of the six selected images, for 
instance image, has a relative importance that is significantly higher than the other five 
selected images the icon layout 12 of Fig. lb is preferably chosen. 

It will be understood that the selection of the number of images that need to be 
incorporated in the icon can be done in several ways. For instance, it may be required that the 
sum of the importance of each of the images included in the icon is minimal a certain 
predetermined value. However, also otiher selection criteria may be appUed. 

Selecting an icon layout may be done by performing at least two steps: 
^) determining the number of images that need to be displayed in the icon, and 

2) selecting a matching icon layout from a phurality of icon layouts, for example 

from a database. 



c) automatic creation of icon 

After the icon layout has been selected, the pictures may be inserted in the 
selected icon layout The size of an image may be directly dependent on its relative 
importance. Also the distance of an image from the centre of the icon can be made dependent 
on its relative importance. e.g., the most important image in the centre, surrounded by the less 
important images. 

Further on, all kinds of optional gr^hical efifects maybe appUed, such as: 
rotation of one or more images, 
partially overlapping of images, 
blending of images, 

addition of frames, borders around images, and 

superimposing of an album title or other metadata such as user annotations. 
Examples of icons are depicted in Figures 2a and 2b, comprising six images 1, 
2, 3, 4, 5, 6 where the relative importance Ii > I2 > I3 > I4 > I5 > le. 

Again, this is preferably done automaticaUy, but may also be done manuaUy. 

d) interactive editing of the icon 
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FinaUy, the user may interactively edit the generated icon. The system should 
preferably aUow the user to interactively edit the resulting icon. With a drag and drop 
function, the user should then be aUowed to easUy change the layout, the size and order of ttie 
images etc. 

When resizing an image, the otber photos may adapt their size depending on 
their relative importance. If a user removes a photo from the icon, the foUowing most 
important image could be automatically selected for substitution. 

It will be understood that this last step is optional for users that are not 
satisfied with the automatically created icon. 

The importance of an image could also be made dependent on the user. In case 
a device, such as a computer, is used by more than one person, tiie computer may determine 
relative importance for each image for each user, since each user has a different viewing 
history. 

The method as described here may also be applied to a number of groups with 
images, instead of to just to a single group of images. For instance, if a user has 3 groups of 
images containing images about sport, and 2 groiqjs of images containing images about 
hoUdays. a first and second icon may be generated representing the sport groups and tiie 
hoUday groups respectively. After a user has selected, for instance, the icon representing the 
group of hoUday images, two further icons are presented to him, representing the first and 
second groiqi of hoUday images. 

Figure 3 shows a schematic block diagram of an embodiment of the computer 
system 100, comprising processor means 21 for performing arithmetical operations. The 
processor means 21 are connected to memory units that store instructions and data, such as a 
tape unit 19, a hard disk 18, a Read Only Memory (ROM) 24. Electrically Erasable 
Programmable Read Only Memory (EEPROM) 23 and a Random Access Memory (RAM) 
22. The processor means 21 are also connected to one or more input devices, such as a 
keyboard 26 and a mouse 27, one or more output devices, such as a display 28 and a printer 
29, an input device such as a scanner 504, and one or more reading units 30 to read for 
instance floppy disks 17 or CD ROM's 20. The con^uter system 100 may fiirther comprise 
an input/output device 7, for providing data traffic with a network 31 . 

However, it should be understood that there may be provided more and/or 
other memory units, input devices and read devices known to persons skilled in the art. 
Moreover, one or more of them may be physically located remote from the processor means 
21, if required. The processor means 21 is shown as one box, however, it may comprise 
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several processing units functioning in parallel or controlled by one main processor, that may 
be located remote from one another, as is knoAvn to persons skilled in the art. 

It is observed that, although all connections in Fig. 3 are shown as physical 
connections, one or more of these connections can be made wireless. They are only intended 
5 to show that "connected" xmits are arranged to conmiimicate with one another in someway. 

The computer system 100 is shown as a computer system, but can be any 
signal processing system with analog and/or digital and/or software technology arranged to 
perform the functions discussed here. 

The memory units may contain the program instructions for cartying out the 
10 method as described above. The computation of the importance of each image maybe carried 
out according to these program instructions by the processing means 21, as will be 
understood by a person skilled in the art. 

According to an embodiment of the invention, the program instructions are 
such that a flow diagram as depicted in Fig. 4 is executed. 
15 The computer system 100 iBrst records the :&ctors that are relevant for 

determining the importance I of each image, such as the time an image is displayed, the 
presence of manual annotations, number of times an image bas been selected for a slide show 
etc, as already listed above. The recorded :&ctor5 may be stored in tiie memory units 19, 18, 
24, 23, 22. This is step 40 in Fig. 4. 
20 After the relevant factors are stored in the memory umts 19, 18, 24, 23, 22, in 

step 42 the computer system 100 collects this data and computes tiie importance I for each 
image, that is stored in the memory units 19, 18, 24, 23, 22 in step 44. The importance 
associated to an image may be stored in a table for successive re-use. The importance may 
also be stored as metadata attached to the images 
25 Based on this stored importance I of each image, the computer system 100 

determines in step 46 the nxmiber of images that need to be incorporated in the icon. The 
result of this is used in step 48 to select an icon that matches the number of images to be 
incorporated in the icon. Based on the relative importance of these images, an icon is selected 
or generated that represents the relative importance of the images. 
30 In step 50, the icon is created and presented to the user. Finally, the user might 

interactively edit the icon in step 52. 

It will be understood that the computer system 100 could be arranged to 
constantiy monitor if any of the relevant &ctors has changed, so the icon can constantly be 
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monitored. On the other hand, the computer system may also be arranged in such a way that 
the icon is only changed based on new recorded relevant factors at certain time intervals. 

It will further be understood that an image of which the relative importance is 
determined may be a picture or a drawing, but may also be an icon in itself, as for instance an 
5 icon representing a movie, such as a cinema poster, DVD cover, or may be an icon 
representing a computer program or applicatioa, that may be run on a computer. 

In the first case, where the image is an icon representing a movie, the relative 
importance may be determined by the number of times a movie is viewed or copied. 

In the second case, where the images are icons representing computer 
10 programs or applications, the icon that is generated based on the determined importance of 
the different images (in this case: the program icons) may be the desktop of a computer. In 
practice this means that the appearance of Ihe desktop of the computer, i.e. the position, order 
and selection of displayed icons, is determined by the determined importance of each 
program icon. 

1 5 The invention may also be used for creating an icon, where the group of 

images together forms a movie. The icon is than composed of a selection of images Scorn that 
movie, i.e. a selection of stills ftom the movie. The relative importance of each still is 
determined and an icon is generated based on the determiaed relative importance of each 
image. The relative importance maybe based in a similar way as described above. The group 

20 of images may also be a predetermined number of stills from a movie, from which the 
relative importance is determined. 

According to a ftirther aspect of the invention, the determined relative 
importance of the different images may also be used to adjust the order in which the images 
are stored or presented to the user. For instance, when a user wants to view all the images of 

25 a certain group, the order in which the images are presented to the user may be presented to 
the user in order of decreasing importance. This may help the user to find a certain image 
more quickly. This aspect of the invention may be applied in combination with the above 
described method for generating an icon, but may also be applied separately. 

For the purpose of teaching the invention, preferred embodiments of the 

30 method and devices of the invention were described above. It will be apparent for the person 
skilled in the art that other alternative and equivalent embodiments of the invention can be 
conceived and reduced to practice without departing from the true spirit of the invention, the 
scope of the invention being only limited by the annexed claims. 
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CLAIMS: 



1- Method for creating an icon (1 1, 12), representing a group of images 
comprising a plurality of images (1, 2, .... N), where the icon is composed of a selection of 
images from that group of images, characterised in that the method comprises: 

determining a relative importance (Ii, . . .1^) of each image (1 , 2, ... N) and 
generating an icon composed of a selection of images based on the determined 
relative importance of each image. 

2- Method of creating an icon according to claim 1, where the relative 
importance of each image (1 , 2, . . N) is determined based on at least one of: 

the time span an image is displayed, 
the presence of manual annotations^ 

number of times an image has been selected for a slide show, 
number of copies that have been printed and/or sent, 
explicit user rating, 

rareness in the collection measured using image similarity, 

presence of faces (or other objects) detected with automatic face (object) 

detection. 

3. Method according to claim 1, where the number of images that is incorporated 
in the icon is selected based on the determined relative importance (Ii, . . .In) of each image 
(1,2,...N), 

4. Method according to claun 1, where the layout of the icon is selected based on 
the determined relative importance (Ii, ...In) of each image (1, 2, ... N). 

5- Method according to claim 1, where the size of each selected image in the icon 

is proportional to the relative importance (Ii, ...1^) of each image (1, 2, ... N). 
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6 , Method according to claim 1 , where the position of each selected image in the 
icon depends on the relative importance (Ii, . . .In) of each image (1, 2, ... N). 

7 Method according to claim 1, where the group of images comprises a plurality 
of stills from a movie. 

8. Method according to claim 1, where the group of images comprise a plurality 
of icons, for instance representing a group of images, a movie, a computer program or 
application. 

9. Method according to claim 8, where the icon is a desktop. 

10. Method according to claim 1, where tihe method fttrther comprises 
determining a relative order based on the determined relative importance of 

each image. 

1 1 . Con5)Uter system (100) comprising processing means (12) and memory means 
(13, 14, 15, 16), the processing means (12) being arranged to communicate with the memory 
means (19, 18, 24, 23, 22), the computer system (100) being arranged to create an icon (1 1, 
12), representing a group of images comprismg a pluraUty of images (1, 2, N), where the 
icon is composed of a selection of images from that group of images, characterised in the 
following 

the processing means (12) is arranged to determine a relative importance (Ii, 
...In) of each image (1,2, ...N)and 

the processing means (1 2) is arranged to generate an icon con5)osed of a 
selection of images based on the determined relative importance of each image. 

12. Computer program product to be loaded by a processor in a computer system 
(100), the computer system comprising processing means (12) and memory means (13, 14, 
15, 1 6), the processing means (12) being arranged to communicate with the memory means 
(1 9, 1 8, 24, 23, 22), the computer program product bemg arranged to carry out a method for 
creating an icon (11, 12), representing a group of images comprising a pluraUty of images (1, 
2, N), where the icon is composed of a selection of images from that group of images, 
characterised in that the method comprises: 
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determining a relative importance (li, ...In) of each image (1, 2, ... N) and 

generating an icon composed of a selection of images based on the determined 
relative itoportance of each image. 

13. Data carrier comprising a computer program product in accordance with claim 

12. 



14. Method for detennining a relative order of a group of images comprising a 

pluraUty of images (1, 2,..., N), characterised in that the method comprises: 

determining a relative importance Oi, ...In) of each image (1, 2, ... N) and 
determining the relative order based on the determined relative inqwrtence of 

each image. 
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ABSTEIACT: 



The present invention relates to a method for creating an icon (1 1,12), 
representing a groi^ of images comprising a pluraUly of images (1, 2, .... N). The icon is 
composed of a selection of images from that group of images. The metiiod comprises: 

determining a relative in^ortance (Ii, ...1^) of each image (1, 2, ... N) and 
generating an icon composed of a selection of images based on the determined 
relative itnportance of each image. 
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